Facial deformation parameters for audiovisual synthesis
نویسندگان
چکیده
Extracting reliable 3D facial deformation parameters from static facial postures is a major component of our system for audiovisual synthesis. This paper describes several important improvements to that process, including reduction of position alignment errors, simplification of the generic face mesh and, most important, increasing the range and variety of static postures used.
منابع مشابه
A text-to-audiovisual-speech synthesizer for French
An audiovisual speech synthesizer from unlimited French text is here presented. It uses a 3-D parametric model of the face. The facial model is controlled by eight parameters. Target values have been assigned to the parameters, for each French viseme, based upon measurements made on a human speaker. Parameter trajectories are modeled by means of dominance functions associated with each paramete...
متن کاملVideo-realistic synthetic speech with a parametric visual speech synthesizer
The author presents a new face module for MASSY, the Modular Audiovisual Speech SYnthesizer [1]. Within this face module the system combines two approaches of visual speech synthesis. Although the articulation space is parameterized in terms of movements of the articulators, the visual synthesis is image based (video-realistic). The high-level visual speech synthesis generates a sequence of con...
متن کاملStudies of audiovisual speech perception using production-based animation
This paper will summarize our work at Queen's University and ATR Laboratories on cross-modal speech perception and production. Our approach has been to study these two sides of speech together and to use the multi-modal speech production data to parameterize and control audiovisual animation systems. Two approaches to production-based facial animation have been pursued — one statistical and the...
متن کاملSynthesis of human facial expressions based on the distribution of elastic force applied by control points
Facial expressions play an essential role in delivering emotions. Thus facial expression synthesis gain interests in many fields such as computer vision and graphics. Facial actions are generated by contraction and relaxation of the muscles innervated by facial nerves. The combination of those muscle motions is numerous. therefore, facial expressions are often person specific. But in general, f...
متن کاملUsing multimodal speech production data to evaluaterticulatory animation for audiovisual speech synthesis
The importance of modeling speech articulation for high-quality audiovisual (AV) speech synthesis is widely acknowledged. Nevertheless, while state-of-the-art, data-driven approaches to facial animation can make use of sophisticated motion capture techniques, the animation of the intraoral articulators (viz. the tongue, jaw, and velum) typically makes use of simple rules or viseme morphing, in ...
متن کامل